Papers with generation-based methods

8 papers
Deep Chit-Chat: Deep Learning for ChatBots (D18-3)

Copied to clipboard

Challenge: tutorial focuses on building conversational models with deep learning approaches for chatbots.
Approach: This tutorial focuses on building conversational models with deep learning approaches for chatbots.
Outcome: The tutorial summarizes the fundamental challenges in modeling open domain dialogues . it also covers some new trends of research of chatbots - such as how to "control" conversations with specific information .
Logical Form Generation via Multi-task Learning for Complex Question Answering over Knowledge Bases (2022.coling-1)

Copied to clipboard

Challenge: Existing generation-based KBQA methods that translate natural language questions to executable logical forms are proving promising but noise introduced can lead to incorrect results.
Approach: They propose a Generation-based KBQA method that uses auxiliary information to enhance logical form generation by combining unseen KB items with novel combinations.
Outcome: The proposed method achieves state-of-the-art results on ComplexWebQuestions and WebQuestIONSSP datasets.
Retrieval-Augmented Generative Question Answering for Event Argument Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to extract arguments from documents are based on generating and post-processing a complex target sequence (template).
Approach: They propose a retrieval-augmented generative QA model that retrieves the most similar QA pair and augments it as prompt to the current example's context, then decodes the arguments as answers.
Outcome: The proposed model outperforms prior methods across fully supervised, domain transfer, and fewshot learning settings and compares with clustering-based sampling strategies.
Dynamic Prefix-Tuning for Generative Template-based Event Extraction (2022.acl-long)

Copied to clipboard

Challenge: Experimental results show that our model achieves competitive results with the state-of-the-art classification-based model OneIE on ACE 2005.
Approach: They propose a generative template-based event extraction method with dynamic prefix . they integrate context information with type-specific prefixes to learn a context-specific name for each context .
Outcome: The proposed method achieves competitive results with state-of-the-art model OneIE on ACE 2005 and performs well on ERE.
ClauseRec: A Clause Recommendation Framework for AI-aided Contract Authoring (2021.emnlp-main)

Copied to clipboard

Challenge: Contracts are a common type of legal document that frequent in business workflows, but there has been limited NLP research in understanding and generating them.
Approach: They propose a task of clause recommendation to help automate contract authoring . they first predict if a specific clause type is relevant to be added in a contract . then they propose two-staged pipeline to recommend top clauses based on the contract context .
Outcome: The proposed pipeline predicts if a clause type is relevant to be added in a contract and recommends the top clauses for the given type based on the contract context.
A Unified One-Step Solution for Aspect Sentiment Quad Prediction (2023.findings-acl)

Copied to clipboard

Challenge: Existing ASQP datasets are small and low-density, hindering technical advancement . et al. (2017): aspect sentiment quad prediction provides a complete aspect-level sentiment structure.
Approach: They propose a one-step solution for Aspect sentiment quad prediction that can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously.
Outcome: The proposed solution can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously.
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results indicate that, compared to previous SOTA methods, OK-IE requires only 1/100 of the training data (900 instances) and 1/120 of the time (3 minutes) to achieve comparable results.
Approach: They propose a framework that transforms OpenIE into the pre-training task form of the T5 model, thereby reducing the need for extensive training data.
Outcome: The proposed framework transforms OpenIE into the pre-training task form of the T5 model, reducing the need for extensive training data and significantly reducing training time.
DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration (2025.emnlp-main)

Copied to clipboard

Challenge: Existing LLMs fail to capture the dual nature of medical consultation (MC) this mismatch often results in ineffective symptom inquiry and unreliable disease diagnosis.
Approach: They propose a novel LLM-based framework that performs Dual-Decision Optimization by decoupling the two sub-tasks and optimizing them with distinct objectives through a collaborative multi-agent workflow.
Outcome: The proposed framework outperforms existing LLM-based approaches on three real-world MC datasets and achieves competitive performance with state-of-the-art generation-based methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations